A CLASS OF SUMS OF SQUARES WITH A GIVEN 
POISSON-TREVES STRATIFICATION 



ANTONIO BOVE AND DAVID TARTAKOFF 

Abstract. We study a class of sum of squares exhibiting the same 
Poisson- Treves stratification as the Olcinik-Radkevic operator. We 
find three types of operators having distinct microlocal structures. 
For one of these we prove a Gevrey hypoelhpticity theorem anal- 
ogous to our recent result for the corresponding Oleinik-Radkevic 
operator. 



1. Introduction 

The problem of analytic liypoellipticity for second order operators 
which are sums of squares of vector fields with analytic coefficients has 
been widely studied and has been around since the paper of L. Horman- 
der on C°° hypoelhpticity for this type of operator. In particular 
D. S. Tartakoff |2S!, for second order, and F. Treves [26j for gen- 
eral order, gave general analytic hypoelhpticity theorems for the case 
when the characteristic manifold is symplectic and the operator degen- 
erates on it to an exact order. In the case of non exact and higher 
order degeneracy O. Oleinik ^T] and O. Oleinik and R. Radkevic [22] 
(see also Christ ^j) showed that in general one cannot have analytic 
hypoelhpticity (see also the paper ^ by the present authors for a pre- 
cise and optimal partial regularity result in the case of the operator 
studied by Oleinik and Radkevic), but only certain degrees of Gevrey 
hypoelhpticity. 

Into this scenario there appeared in 1999 the well known paper by 
F. Treves j2H] introducing the notion of Poisson stratification for a set 
of vector fields satisfying Hormander's Lie algebra condition and having 
analytic coefficients. Basically, crudely simplifying Treves' setting, the 
conjecture states that an operator which is a sum of squares of vector 
fields is analytic hypoelliptic if and only if every layer in its Poisson 
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stratification is symplectic. To our knowledge the conjecture has been 
neither proved nor disproved up to now. 

In this paper, the first of a series, we study an operator which is 
the sum of the squares of three vector fields with analytic coefficients 
in three variables. For such an operator we assume that its Poisson- 
Treves stratification is given in such a way that its Hormander numbers 
are the same as those of the Oleinik-Radkevic model operator. Here 
by Hormander numbers we mean both the number and the relative 
codimensions of the stratification's layers. Our purpose is to classify 
such kind of operators and obtain their Gevrey (or possibly analytic) 
hypoellipticity threshold. 

In the present paper we classify the operators having the required 
properties and, for one of the classes, we obtain the same Gevrey hy- 
poellipticity threshold as that of the Oleinik-Radkevic model operator. 
We are unable to deduce these (optimal) results for every class of opera- 
tors sharing the Poisson- Treves stratification with the Oleinik-Radkevic 
model, but we shall come back to this subject in a forthcoming paper 

Before stating our assumptions precisely, we want to make a couple 
of remarks. 

1. Our vector fields are linearly independent outside of the character- 
istic manifold. This essentially implies that the characteristic manifold 
is cylindrical with respect to a two dimensional subspace of the fibers 
of the cotangent bundle, or in other words, it is the zero set of one 
covariable and one function of the variables in the base. This restric- 
tion eliminates cases where two of the vector fields can become colinear 
outside of the characteristic set. On the other hand, many results are 
known for the case of the sums of two squares. 

2. The Oleinik-Radkevic model operator has a codimension 2 symplec- 
tic characteristic manifold. In three dimensions one might consider also 
cases where the characteristic manifold is symplectic and of dimension 
4 or has symplectic layers of codimension 2 and symplectic layers of 
codimension 4. Even for the sums of two squares, though, this situa- 
tion faces difficulties of the same kind as those appearing in Christ's 
example 
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In the first part of the paper we deduce some standard forms (cf. 
Theorem 16.3.11) below) that can be useful in proving a priori estimates. 
Then we proceed to prove a Gevrey hypoellipticity threshold for one of 
these standard forms (cf. Theorem 19. 1|) 

Essentially the operators verifying our assumptions fall into three 
classes, depending on how the vector fields vanish on the characteristic 
set. For the first case, called Case 1, we make a finer analysis of the 
extent to which the vector fields under consideration are linearly inde- 
pendent outside of the characteristic manifold. This is accomplished by 
looking at each of the "characteristic" vector fields and computing it 
on the null bicharacteristic curve of the only non characteristic vector 
field. 

This operation does not affect the covariables (i.e. affects only the 
coefficients of the base), since the null bicharacteristic curve is a curve 
in the base variables. Then one focusses on the zero set of the resulting 
vector fields. Computing the symbol of one of the vector fields on the 
zero set of the other allows us to define a sort of degeneracy rate which 
turns out to be useful in the a priori estimates. The last section of the 
present paper is concerned with the case when the above mentioned 
degeneracy rate is zero. Then we obtain the same (optimal) result as 
for the Oleinik-Radkevic model. 

If the degeneracy rate is larger than zero, the estimates are deduced 
in a very different way and yield a different result. This is the subject 
of a forthcoming paper. 

The second and third classes (called Case 2a and Case 2b below) will 
also be studied in a subsequent paper. 

2. Assumptions 

We now specify the assumptions. Our operators have the general 
form 

3 

P(x,D) = 5^X|(x,D), 

i=i 

where x G and Dj = j = 1, 2, 3. Here Xj denotes a vector field 
with real analytic coefficients defined in a neighborhood of the origin 
in the x variable. 
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The following assumptions try to mimic the fact that P has the same 
Poisson-Treves stratification as the operator D'l-\-xf^~^'' D'^^-x^^'^'^^ D^^ 
where p and q are integers and 1 < p < g. 

(Al) The operator P satisfies the Hormander Lie algebra condition 
and hence is hypocUiptic. As a consequence not all the 
vector fields are characteristic (i.e. have vanishing coefficients) 
on the characteristic manifold. Hence we may suppose without 
loss of generality that 

X^{x,D) = D^. 



(A2) We may always assume that the point (0; 63) is a characteristic 
point for P (using a translation and a rotation if necessary). 
Wc assume then that near (0; 63), the characteristic set of P is 
an analytic symplectic submanifold of T*M^ \ of codimension 
two which we denote by Ei. We exphcitly note that this is a 
microlocal assumption. 

(A3) Let = [/ X r a conic neighborhood of the point (0,63). And 
let TTi : [/ X r ^ f/ be the projection onto the space variables. 
We assume that the vector fields 

are linearly independent; the above notation means that re- 
stricting the coefficients of the fields Xj to the space projection 
of El yields linearly independent vectors in R^. 

Note that, because of (A2), the coefficients of the vector fields 
depend non trivially on the x variable. This assumption has 
strong implications on the structure of Ei and, to avoid technical 
details at this point, we refer to Section 3. 

(A4) 

E2 = {(a;,0 e T*M3 \ I (x,C) G Ei, {X„ X,}(x, = 0, 

i,je {1,2,3}}, 
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and, in general, let / = {ii, . . . ,ik),ij G {1, 2, 3}, for j — 1, . . .k. 
Writing |7| = A;, we denote by Xj the iterated Poisson bracket 

Xi = {Xi^, {Xi^, ... ,{Xi^_^, Xi^} ...}} 

of the vector fields Xj, j = 1, 2, 3; set 

= {{x, e T*R' \ I (x, e Xi{x, = 

for every index / such that |/| = h}. 

Let p < qhe two positive integers. Then we make the following 
assumptions: 

(i) El n n = • • • = Ep_i n n. 

(ii) Ep n Q is a non-empty analytic submanifold of Ei fl Q of 
codimension one. 

(iii) EpHQ^ Ep+i n Q = • • • = Eq_i n Q. 

(iv) Eg n Q is empty in T*R^ \ (i.e. Eg fl Q is contained in the 
zero section of the cotangent bundle over fl.) 



3. Standard Forms: The equations of Ei 

Due to the above assumptions we may suppose that the vector fields 
have the following form: 



(3.1) 



Xiix,0 = 6 

X2{X, = 021 (x)5 + a,22{'X)^2 + a23{x)^3 

Xsix,^ = «3i(a:)6 + «32(a;)6 + a33(a;)6- 
Hence = is one of the two equations defining Ei; letting 



A{x) 



a22{X) a23{X) 

a32{x) 033(3;) 



(the Qjk being analytic), the other equation is given by 

(3.2) A(x)e = 0, 

where ^' = (6.60- 

We claim that this can only be the second defining condition of Ei 
if A{x) = on El (locally). For suppose (xo,Co)) ^0 7^ 0' ^^^^ ^^^^ 



(3.3) 



A{xo)^', = 
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and assume that to the contrary, for x near xq on Ei, 

(which we will write as A{x) ^ 0). 

This implies that at Xq the rank of A is equal to 1 since 7^ e 
kerA(xo). It follows that, in a conic neighborhood of (xo;0,^o)> 
characteristic manifold Ei is defined by 

El = {(x,0 I 6 = 0,det^(x) = 0,^' e ker^(x)}, 

because we may always assume that rank^(a;) > 1 near xq. 

Since A{xq) ^ 0, the latter two equations in the definition of Ei are 
certainly independent (the second of them has non-zero ^'-gradient, 
while the first of them must have a non-zero ,x-gradicnt). As a con- 
sequence one of them must be identically satisfied in order to accom- 
plish the codimension 2 condition. Since ranka4(xo) = 1, the condition 
6 G kci A{x) cannot be identically satisfied. Hence the only possibility 
is that 

det A{x) = 

in a full neighborhood of Xq. However this fact would imply that there 
exist points (a;, ^), {1 = 0, (a;, ^ Ei, such that the vector fields Xi, 
X2, X3 are not linearly independent. 

Consequently the only possible case left is that A is the zero matrix: 



A{x)j^ 



(3.4) A{x) = 0, 
if (x,^) G El. This means that 

(3.5) Si = {(x,0 \^i = 0,A{x) = 0}. 

Hence the matrix condition A{x) = must be (locally) equivalent to 
fi^x) = 0, where 99 is a real analytic scalar function and such that 
d^^{x) 7^ 0. 

By Assumption (A2), {ii,^{x)} 7^ at Ei. Hence by the implicit 
function theorem the equation (p{x) = is equivalent to the equation 

(3.6) xi - g{x') = 0, 

where g is a suitable real analytic function, x' = {x2,X3), and g is 
defined locally. We conclude then that 

(3.7) ^i = {{x,0 16 = 0, x^-g{x') = 0}, 
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and that 

(3.8) A{x) = {xi-g{x'))A{x), 

for a suitable 2x2 matrix A with real analytic entries Uij, i,j e {2, 3}. 

Next we perform a change of variables (and hence a canonical trans- 
formation) which is linear in ^, so that vector fields are mapped to 
vector fields in the new coordinates, allowing us to make the function 
g identically zero. 

Define: 





yi 


= xi + g{x') 




= 6 




(3.9) 


y2 








•SI 9X2 






= X3 


V3 


= 6 


- ^1-^ 



The three vector fields become: 



X2{y,v) = (a2i{yi- g{y'),y') + yia22{yi- g{y'),y') 



dgjy') 
dy2 



+yia23(yi - 9(y'),y')^^) m 

+yi [a22{yi - 9{y'),y')v2 + 023(1/1 - 9{y'),y')v3.] 

dgjy') 



X3{y,v) = (asiiyi- g{y'),y') + yia32{yi- g{y'),y' 
+yi~a33{yi-9{y'),y'f-^) vi 



dy2 



+yi [032 (z/1 - 9iy'),y')v2 + 033 (z/i - 9iy'),y')v3] ■ 

The above fields can be rewritten, with obvious notation, in the follow- 
ing way: 

(3.10) -^2(2;, = a2i{x)^i + xi[a22{x)C2 + a23{x)^3] 

Xsix,^ = a3i{x)^i + xi[a32{x)^2 + a33{x)^3\ 

with suitable real analytic functions a^j defined in a neighborhood of 
the origin. 
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4. Standard forms: the equations of E2,...Sp_i 

Let us now turn to Assumption (A4) concerning S2. We have 

{X,(x,0,Xj(x,0}^-^^Xj(x,0, 

ior j — 2,3 and the latter quantity is equal to 

daji{x) 



dxi 



-6 + [%2(a^)6 + aj3{x)^3] + 0{\xi\), 



for j — 2, 3, and 

{X2,X3}(X,0 

= {021^1 + ^1 [«22(a;)6 + a23{x)^3] , 0316 + xi [022(2^)6 + 023(2^)6]}, 
which gives 

(4.1) {X2,Xs}{x,0 = a2i{x){X,,X2}{x,0 - a3i{x){X,,X3}{x,0 

+ 0(1x11 + 161), 

where 0(|xi| + \C,i\) stands for a vector field with principal symbol 
vanishing on Ei. Hence we obtain E2 = Ei n {(a;, ^)| {Xi,Xj} = 0}, 
J = 2,3. 

Let us again denote by A{x) the 2x2 matrix 



022(2;) a23(a;) 
032(2;) 033(2;) 



A{x) 

then Assumption (A4) means that 

(4.2) A{x)e = 
if and only if xi — 0. This implies that 

(4.3) A(x) = xiA(x) 

for a suitable 2x2 matrix A with analytic entries. 

Iterating the above argument we can conclude that the vector fields 
can be written in the form 

(4.4) ^2(2;, = a2i{'x)^i + x'r^ [a22{x)^2 + a23{x)^3] 

Xs{x,^) = asiix)^i + x{~^ [a32ix)^2 + a33ix)^3\ ■ 
We summarize what has been proved up to this point in the 
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Proposition 4.1. Suppose that (A1)-(A3) and (A4)(i) hold. Then the 
vector fields Xi, X2, can be written, in a suitable system of local 
coordinates, in the form \4.4\ )- 

5. The equation defining Sp with respect to Si 

Let us denote by ip{x', a real analytic function defined on a (conic) 
neighborhood of (0, 63) in Si and such that d(x',^')^{0, 63) 7^ and the 
equation ip{x', = is equivalent to ^4(0, x')^' = 0. 

We have either 

(5.1) ||(o,e3)^0 (Case!) 
or 

(5.2) ^(0,63)7^0 (Case II). 

5.1. Case I. For the case of non-zero ^ gradient, assume that it is the 
^2 derivative of ip that is non-zero at (0, 63) (we will see below that the 
case of a non-zero ^3 derivative cannot occur). Then we may write 

(5.3) ^(x',0 = (6-x(a:',e3))e(a;',0, 
where e and x a-^e analytic and e(0, 63) 7^ and thus 

^{x', = ^ 6 - X{x', 6) = ^ A{x')e = 0. 

We claim that xi^'^^') has the simpler form x{^')^3j a-^id to see this 
let t denote a non-zero real number; if A{x')C,' = then obviously 
A{x')t^' = 0. Thus {x',^') e S2 ^ ix',t^') G S2, so that t^2 - 
Xix',t^3) = 0. Since ^2 = we have xix',t^s) = txix',^3) for 

every non-zero real number t. But now ^3 7^ in a conic neighborhood 
of (0, 63), so that x{x', (,3) = C,3x{x', 1) = C,3x{x'), for a suitable analytic 
function x of the space variable only, and so finally we obtain 

(5.4) A{x')e = 0^6- x{x'K3 = 0, 

where we have written x again for the function x- 

The above formula has been derived in the case that it is the ^2 
derivative of if that is non-zero at (0,63). Now suppose that the ^3 
derivative of (p is non-zero at (0, 63) instead. Then arguing as above 
we find that the equation ip{x',C,') = is equivalent to ^3 — x{x',C,2) = 
0. As before, let t be a non-zero real number; now, since if {x', 
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belongs to Sp then also (x', t^') belongs to Sp, keeping in mind that, 
by assumption, the point (0, 63) belongs to Sp, we find that t = x(0, 0) 
for any t G M \ 0, which is absurd. 

We thus have proved that if 1)5.11) is true then the equation defining 
Sp relatively to Si is given by ()5.4|1 . 

5.2. Case II. We now turn to the case where <f'^{0, 63) = but 

(5.5) ^(0,63)^0 (Case II) 
and we assume here that 

(5.6) 1^(0,63)^0 (CaselLj. 
0x2 

The case ^92:3 (0,63) 7^ (Case 11^3) has some obvious but non-trivial 
differences that we shall stress later. 

Arguing along the same lines as above we obtain that there is a 
function xi^s^O such that the equation ip{x',^') = is equivalent to 
^2 — x(^3)^') = 0. Here x is analytic and defined on a conic neigh- 
borhood of (0,63) in X (M|, \ 0). Again we may assume that on 
that neighborhood ^3 is not zero. Moreover if t denotes a non-zero real 
number we obtain that xi^^i^i') = x{^3:^')y so that 

(5.7) A{x')^' = 0^x2- x(x3, ^) = 0, 

where we have denoted by x(x3, a) the function ^(^^s, o", 1)- 

We point out that the function x ()5.7|) is an analytic function 

defined in a neighborhood of the origin in M^^g x Rg-- 

From ()5.7|) we obtain that there is a positive integer k such that 

^2 .^ 



(5.8) A{x')e = 1^X2 - x{x3, g) J B{x', eO, 

where B{x',^') denotes an analytic 2-vector defined and non-zero in a 
conic neighborhood of (0,63). The existence of such an integer is a 
consequence of our analyticity assumption. 

Our aim is to draw some consequences from the linearity of the left 
hand side of Equation ()5.8|) with respect to 
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Assume first that A; > 1 in ()5.8|1 . Then taking the ^-gradient, we get 

A(a;') = 1^(^X2 -x(x3,|)' 

which implies that x{^3j^2/C,3) actually depends only on x^. Thus 
B{x',C,') is linear with respect to so that we obtain 

(5.9) A{x')e = {x, ~ xixs))' A{x')e , 

where A{x') denotes another 2x2 matrix with real analytic entries. 
Let us now assume that k = 1. Equation ()5.8|) becomes 

(5.10) A{x')e = ^ix',aBix',^'), 

where is a vector- valued symbol of order 0. Recall that we are as- 
suming that 

<^(0,e3) = 0, 1^(0,63) = 0, and ^(0,63)^0. 

Since the vanishing in (j5.1U|) is of the first order, we have that -8(0, 63) 
7^ 0; in particular we may assume that 

5(0,63) = (&2(0,e3),63(0,e3)) 

and 

(5.11) 63(0,63) ^0. 

This is no restriction since we can always interchange the second and 
the third vector fields. Taking the ^'-gradient of ()5.10|) and computing 
everything at (0,63), we easily see that A{0) = 0. Hence 

(5.12) A{x') = X2 (x') + X3 {x') , 

where the A^^^ are real analytic 2x2 matrices, j = 2, 3. From this 
equation we obtain 

^ A{x')e = ^B{x',a+^ix',a^{x',a, 



3X2 0X2 ' ' 9X2 

which, when computed at (0,63), yields 



dA{0) 
dxo 



1^(0,63)5(0,63). 

0x2 
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Let us now consider the second component of the above equation: we 
have, from ()5.11|) . 

\ / J x' = ^' = 63 

from which we deduce that 

(5.13) 4?(0)^0. 

The second hne of the equation A{x')C,' = then reads: 

(5.14) {x2a'g{x') + x.af^ix')') 6 + {x^a'Hix') + x^a^^ix')') ^3 = 0. 

Because of fl5.13|) this is the equation of an analytic submanifold of 
codimension one containing the point (0,63) and, since ^3(0, 63) 7^ 0, 
()5.10|) imphes that ()5.14|) is equivalent to ip{x',^') = 0. 
Thus we are allowed to change notation and write 

(5.15) ^{x',e) = (x24J(x') +X34?(a;')) 6 

+ (2^243 (2;') + ^safsix')^ ^3, 

where 

(5.16) 4? (0)7^0, 

(recall that we are in Case 11x2 where (px^ 7^ at (0, 63)). 

The following Lemma will help distinguish between two very different 
types of families of vector fields. They are both in Case II and will 
be denoted Case Ila and Case lib, which of course will be further 
subscripted according to whether ipx^ 7^ or ipxs 0- 

Lemma 5.1. Let A and fi be real analytic functions defined in a negh- 
borhood of the origin and consider the vector field 

d d 
Y = \{x')— + ii{x') 



8x2 dxs 

Assume that the symbol ofY, \{x')^2 + Ai(a;')^3; vanishes where (p van- 
ishes, if being defined in Equation \5.15]) . Then two cases may occur: 
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(a) The set (f~^{0) is cylindrical in the ^.'-fibers. Then (f{x',C,') = 
if and only if g{x') = 0, for a suitable analytic function g 
defined in a neighborhood of the origin and having a non-zero 
x' -gradient. In this case 

Y{x\0=9{x')Y{x',i'), 

for a suitable vector field Y . 

(b) The set y9~^(0) is not cylindrical in the ^'-fibers. Then there 
exists an analytic function of x' , h{x'), defined near 0, such 
that 

Y{x',0=h{x'Mx',a- 
Proof. Let us write the function (p in ()5.15|1 as 

<^(x',0 = «(^')6 + /5(2;')6, 

where, by ()5.16|) . dp{0)/dx2 7^ 0. The vanishing of the symbol of Y 
where if vanishes can be expressed by the following equation: 

where a is a suitable analytic symbol of order — actually homogenous 
of degree zero — defined near the point (0,63). 

Dividing by ^3, which is non-zero near 63, and writing a = ^2/^3, we 
have 

for a suitable positive constant C . Thus 

/i(x') 



a(x', 0, 1) 



(3{x'y 

which is also analytic with respect to the variable x' near the origin. 
Since /3(0) = and dp{0)/dx2 7^ 0, we have that /3~^(0) is a regular 
analytic curve in near the origin. Hence there exists an analytic 
function 7(x') defined near such that 

fiix')=^ix')(3{x'), 

and thus 

A(x> + 7(xW) 
a{x')a + Pix') • 

Now we have 
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da aa + /3 {aa + /3)^ 



Setting (T = in the first line and taking into account the analyticity 
of the left hand side, we obtain that 

\{x') = a{x')-f{x') + 6{x')(3{x'), 

for a suitable analytic function S defined near the origin. On the other 
hand, for o" = 0, the second line gives 



(^-J a{x',aX 



a{x') 



P{x') 



= {-l)''{h+l)\S{x') 

Now two cases may occur: 

i) Assume that /9 is a factor of a, i.e. that a{x') = r]{x')P{x')'' , 
for a suitable positive integer k and a suitable analytic function 
T). In this case <f{x',C) = {vf3^~^^2 + ^3)f^{x'), with (3{0) = 0, 
dp{0)/dx2 ^ and {riP'''^^2 + 6)U'=o e=e-a ^ 0. We conclude 
that <^~^(0) = /5~^(0), or that ^^"^(O) is the zero set of a function 
of x' only. Moreover in this case we have that A = {ril3^~^ + 5)13, 
so that 

A(a:')6 + /^(a:')e3 = 

P{x') [{r^{x'mx'f-' + K^')) 6 + 7(^06] , 

which is the conclusion in part (a) of the statement of the 
Lemma. 

ii) The function (3 is not a factor of a, i.e. the quotient a/ j3 is not 
analytic near 0. Then necessarily we must have that 5 = if 
/5 = 0. But then it is easy to see that there exists a positive 
integer h such that 5/13^ is not analytic near the origin, unless 
5 = in a neighborhood of the origin. Thus 

A(a;') = a(x')7(a;'), 

at least in a possibly smaller neighborhood of the origin. The 
above equation implies that 

\{x')a + /x(x') = 7(x') {a{x')a + /3(x')) , 
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which is the desired conclusion for part (b) of the Lemma. 

□ 

Summing up we can state the following 

Proposition 5.1. Assume that the quantity A{0,x')$,' vanishes exactly 
on an analytic submanifold Sp of codimension one inside Si. Let us 
denote by Lp{x',^') = a (microlocal) equation of Ep near the point 
(0, 63) G Sp. Then the following cases may occur: 

I) If 

then necessarily d(p/ 8^2(0, 63) ^ and the equation (p{x', — 
is equivalent to 

(5.17) 6 = 0, 

provided a suitable change of coordinates is performed near the 
x' -origin. 

In particular we deduce that in this case rank74(0) — 1 so 
that, on Tip we also have rankA{x') — 1 near the origin. 

II) Assume that 



and 



Then the following cases may occur: 

(a) The equation of Sp relatively to Si does not depend on C,', 
i.e. Sp is cylindrical with respect to the ^'-fibers. Then we 
may change coordinates near the origin in such a way that, 
in Si, Sp is defined by the equation 

(5.18) Xj = 0, 

where j G {2, 3}. 

(b) Denote by ip{x\^') = the equation of Hp in Si. Then if 
dip/dx2{0,es) 7^ m a suitable system of coordinates near 
the origin ip is equivalent to 

(5.19) Y{x',^') = X{x')^2 + X2i3 = 0. 
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Here A denotes a real analytic function such that A(0) = 0. 
On the other hand assume that d!f/dx2{0, 63) = and that 
d{p/dx3{0,e3) 7^ 0. Then the equation ip = is equivalent 
to 



(5.20) 



Yix', O = A(x')6 + fiix')^3 + x,^s = 0, 
where A(0) = 0, fi{0) = 0, 4'yu(0) = 0. 



Proof. To prove the above statement we need only remark that in Case 
I any equation of the form ^2 — x(^')^3 = be written as ,^2 = 0, 
performing a change of coordinates that leaves xi unchanged. 

As for Case Ila it suffices to notice that Sp is given, by what has been 
shown previously, by the equation P{x') = with dx'P{0) 7^ 0. Thus 
we can always change coordinates in the (x2, X3)-plane in such a way 
that j3{x') = becomes 0:2 = if dP/ 8x2(0) 7^ 0, or X3 = otherwise. 

Let us consider the Case lib. If dip/dx2{0,e3) 7^ 0, we have 



V{x',^') = (x2a^k2i^') + a^s^fc? (2^')) 6 + (x2akh^') + ^^(^kii^')) ^3 



where k = 2 or k = 3 depending on which component of the 2-vector B 
in ()5.10|) is elliptic at (0,63); moreover 0^3' (0) 7^ 0. Then we conclude 
that the equation 3:20^3 (x') +0:30^3 (x') = is equivalent to X2—x{x3) = 
0, for a suitable analytic function x defined near the origin. Let us 
perform the following change of variables in the (x2, X3)-plane: 



Then in the new coordinates, modulo a non-vanishing factor, we have 



which gives ()5.19|) . 

Assume now that 9^9/9x2(0,63) = and that dip/dx^^OjCs) 7^ 0. In 
the above expression of (p we then have a^^si^) 7^ ^'^'^ ^k-si^) ~ 0' 
otherwise we would be in the same situation as above. 



with A(0) = and /i(x') = 0(|x'p) which yields Equation dS^DI)- This 




6 

^3 + 



dx{x2) 

(^Xs 



^{x\e) = e{x'){X{x')^2 + X2^3), 



Thus 



completes the proof of the proposition. 



□ 
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Remark. The seemingly pedantic distinction between the X2 and xs 
variable in the proof above will be useful in subsequent work, where we 
shall be concerned with the Gevrey (analytic) hypoellipticity properties 
of our operators. The basic tool for us are microlocal a priori estimates 
and we shall see that, from a microlocal point of view, the Gevrey hy- 
poellipticity thresholds for cases ()5.19p and ()5.20|) . near the same point 
(0,63), are very different. Naturally, near different base points, both 
Cases Ila and lib may occur for the same operator, yielding different 
microlocal hypoellipticity results and the expected local result. 

Using Proposition we can write the vector fields in a simpler way. 

Proposition 5.2. The vector fields Xi, X2 and satisfying hypothe- 
ses (A1)-(A4) can be written in the following way: 



Case I. 



6 



(5.21) 



+xi {a22(a;)6 + a23(a;)6}] 
«3i(a;)6 + [X{x')a{x')^2 
+xi {a32(a;)^2 + hsix)^^}] , 



for suitable functions a{x'), with a{0) 7^ 0, and A(x'). 
Case Ila: 



Xi(x,0 



a2i{x)^i +x^i~^ [xj (522(0, a;')6 + ^23(0, a;')6) 
+xi {a22(a;)6 + a23{x)^3}] 
«3i(a;)6 [xj (032(0, x')6 + «33(0,x')^3) 

+xi {a32(a;)^2 + as^ix)^^}] . 



(5.22) 



X3ix,0 



where j is equal to 2 or 3. 



18 



A. Bove and D.S. Tartakoff 



Case lib: 



(5.23) 



6 

+xi {a22(a;)6 + a23(a;)6}] 
+xi {a32(a;)6 + «33(a;)6}] • 



where a is a non-vanishing analytic function defined in a neighborhood 
of the origin, (3 is analytic and Y{x\E,') is a vector field of the form 

IHB or lEM- 

Proof. Case I is straightforward, due to Proposition 15.11 The same 
proposition also imphes Case Ila. Case lib follows from Proposition 
15. II and Lemma l5. II fb). □ 

Remark. We point out that, since Si = {xi = 0, = 0}, the forms 
()5.21|) - ()5.23|) for our vector fields actually have some further proper- 
ties, which will turn out to be important for the regularity estimates. 
Basically these properties state that the fields are linearly independent 
outside of the characteristic manifold and that the number of layers of 
the Poisson stratification is finite. We postpone a precise statement of 
this fact until the final step in order not to burden the exposition too 
much. 

The next step consists in using Assumption (A3) and the remaining 
part of (A4) to make the form of the vector fields more precise. 

6. Finer forms for the vector fields 
6.1. Case I. By Proposition 15.21 we are dealing with the fields: 

Xi{x,o = ei 



X3{X,0 



a2i{x) 
a3i{x) 



^i + x'. 



a{x') 
\{x')alx') 



C + x,Aix)e 



with obvious notation. We can see at once that the only brackets that 
matter are 



ad^(Xi)Xfe 



k = 2,3, j =p,p+l,...,q-2. 
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The above quantity vanishes on = {xi = = 0,^2 = 0}, so that, 
taking j = p, we conclude that 



A{x') 
which imphes that 

023(3;) 

Thus we may write the fields as 



xi=0 



0, 



0. 



xi=0 



X3{X,0 



a2i[x) 
a3i{x) 



^1 + xl' 



+Xi 



a{x') + Xia22{x) 
X{x')a{x') + Xia32(x) 

a23{x 



a-ssix) 



6 



for suitable analytic coefficients 0,3, i = 1,2. 

Proceeding analogously and using the remaining brackets, we con- 
clude that 



X2{X,0 
X3{X,0 



a2i[x) 
asiix) 



6 + xl' 



(6.1.1) 



+xl^ 



a{x') + Xia22{x) 
X{x')a{x') + Xia32(x) 

023(3; 



033(2;) 



6 



for suitable analytic functions a{x') 7^ (as always in Case I - cf. ()5.2Hl ). 
Qis, i = 1,2, and A(x'). 

Furthermore the ellipticity of the Poisson brackets of length q tells 
us that 

0" 



(6.1.2) 



A{0,x') 



7^0. 



On the other hand, the fields X2, X3 in 1)6.1.111 are linearly independent 
for Xi 7^ if and only if 

a{x') + Xia22ix) 023(2;) 
X{x')a{x') + Xia23{x) a33(x) 



xl ^det 



7^0, 



I.e. 



Xl 



-X{x')d23{x) + 033(x) + — — det A{x) ^ 0, 

a[x') 
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if Xi 7^ 0, or 
(6.1.3) det 





1 




'I 


( 


\{x')_ 








Xi 



+ — ^A(x) ^ 0, 



if Xi 7^ 0. Another way of stating the above condition is 



( 



-X{x') 
1 



i(a;) 



Xi 



) + — -detA(x) 7^ 0, 
a[x') 



(6.1.4) 
if xi ^ 0. 

6.2. Case Ila. We begin by considering the fields in ()5.22|) and again 
use Assumption (A4) and (A3). Thanks to the remarks made above, 
we can see that, taking p derivatives with respect to xi, we have 

A{x)i' = if xi= Xj = 0, j = 2, 3, 

i.e. 

(6.2.1) A{x) = XiAi{x) + XjA2{x). 

Hence X2 and X3 can be written: 

6 + xr^|x,i(a;')e' 



Xsix^O 



a2i[x) 
031(0;) 



+ (xlAi{x) + xiXjAj{x) ] ^' 



a2i[x) 
a3i(x) 



ei+xrMx,A(x)r+x?A(x)e'L 



the meaning of the symbols being obvious. 

Iterating this argument we reach the following form for the vector 
fields: 



Xi(x,0 



6 



(6.2.2) 



a2l{x)^l + Xi^"^ [Xj {a22{x)^2 + a23{x)^3,) 
+xl"^ (a22(a;)6 + a23(a;)C3)] 
«3l(a;)6 + Xi^^ [Xj {a32{x)^2 + a33{x)^3) 
+xl~^ (a32(a;)6 + a33(a;)C3)] , 

JG{2,3}. 

Proceeding as in Case I we see that the ellipticity of the last Poisson 
layer means that 



(6.2.3) 



det A{x) 



xi=0, Xj=0 
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On the other hand, Assumption (A3) together with ()(i.2.3j] means that 



(6.2.4) 
if xi ^ 0. 



det [xjA{x)+x\~^A{x)] ^ 



6.3. Case lib. Let us consider the fields in ()5.23|) and use Assumptions 
(A3) and (A4). Taking the p-th derivative with respect to xi we obtain 
that 

A{x)i' = Q if xi=0 and r(x',O = 0. 

By Lemma 15.11 (b), this imphes that there is an analytic 2- vector, 
h^^\x'), defined near the origin, such that 

'hS\x') 
h'i^x') 

so that 

i(x)e' = h^^\x')Y{x',0 + xiA^^\x)^' 



A{0,x')^' = h^'\x')Y{x',C), h^'\x') 



and hence 



^2 






021 (x) 








a3i(x)_ 



X 



p-1 



a{x') 
(3{x') 



+ Xih^^\x')]Y{x',^') 



+ x?i«(x)e' 



Iterating this argument we obtain that 

Xiix,0 = 6 



(6.3.1) 



'X2 






021(2;) 


Xs 






_a3i{x)_ 



6 



+xr' <! h{x)Yix',0 + xT''A{x)^' 



where h{x) is a 2-vector function, h{x) = {h2{x) , h^i^x)) , such that 
^2(0) 7^ 0, and A is a 2 X 2 matrix with real analytic entries defined 
near the origin. 

Assumption (A4) then implies that A{x)C,' cannot be zero if xi = 0, 
^1 = and Y{x',^') = 0; but, since ^(0,^') = for every ^' e we 
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detA(O) ^ 0, 



while the hnear independence of the vector fields outside of Ei yields 



if xi 7^ 0. Here Y{x') denotes the 2-vector whose components are the 
coefficients of the vector field Y. 

We summarize the above argument in 

Theorem 6.3.1. Let Xi, X2, satisfy Assumptions (Al) - (A4). 
Then there is a suitable system of coordinates defined in a neighborhood 
of the point (0,63), such that the field can be written in one of the 
following ways: 

Case I) 



^1(^,0 = 6 

(6.3.4) X2(a;,0 = a2i(x)^i + x^^-' [{a{x') + Xid22{x)) ^2 

+Xl~^d23{x)^ 

^3(2^,0 = a3i{x)^i + x^f^ [{\{x')a{x') + xidsiix)) ^2 
+xl~^dss{x)^ , 



for suitable analytic functions dij, i,j — 2, 3, X{x'), and a{x') ^ 
0. Moreover we have 



(6.3.3) 



det{h{x) (g) Y{x') + xl-PA{x)) ^ 0, 



(6.3.5) 



023(0,0;') 
033(0,2;') 



7^0, 



and 



(6.3.6) 



A (x') 523(2;) + 033(2;) + 



a{x'^ 



det A(x) 7^ 0, 



ifx^^^ 



Case Ila) 



Xi(x,0 

^2(2;, 



6 

a2i(2;)6 + x?x^ \xj (a22(2;)6 + a23(2;)C3) 



(6.3.7) 




^3(2;, 



+ x\ \xj (a32(x)^2 + a33(2;)C3) 

+2;?"^ (a32(2;)6 + «33(2;)e3)] , 
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where j G {2, 3}, analytic functions, i,j = 2, 3, such 

that 



(6.3.8) deti(a;) ^0, deti(a;) 

2:1=0 



xi=Xj=0 



^0. 



Moreover 



(6.3.9) det (^XjA{x) + xl~^A{x)^ ^ 0, 



ifxi 7^ 0. 



Case lib) 



(6.3.10) 



Xi(x,0 

) 

X3{X,0 



6 

a2i{x)^i + x\'^ [h2{x) {a{x')i2 + (3{x%i) 
+x\~'^ (022 (x)6 + ^23(3^)6)] 
a3i(a;)6 + [h?,{x) (a(a;')6 + 
+x\~"^ (a32(x)^2 + 033(3^)6)] 



where we may assume that /i2(0) 7^ 0, hj and hij are suitable 
analytic functions, and the field a{x')^2 + l3{x')S,3, has the form 
in i5.19^) or i5.2(j\) . Moreover 



(6.3.11) 



deti(O) ^ 



and 



(6.3.12) det h{x 



a{x') 
f3{x') 



xj-^Aix) ^ 



^fxl^O. 
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7. Examples 

We collect in this section a few examples of the fields obtained in 
Theorem The Case I examples all have the following stratifica- 

tion: 

51 = {xi = 6 = o} 

52 = Si 



{xi = ei = 0, 6 = 0} 



Sp+1 



s, = {0}, 

where {0} denotes the zero section of the cotangent bundle. 

7.1. Case I. 

• Let a = 1, A = 0, 021 = ctsi = and 

A 



1 
1 



Then we have the fields 

Let a = 1, A = 0, 021 = CI31 = and 

A 




1 



Then we have the fields 

which is the Oleinik-Radkevic operator. 
Let a = 1, A = 0, 021 = 031 = and 



A 



1 



X 



q-p-l 







Then we have the fields 
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Concerning the conditions of Theorem Ifi.H.ll we see that the vector 
(a23, 033) is equal to (1, 1) in the first case, (0, 1) in the second case and 
to (1, 0) in the third case. Moreover (jfi.H.fij) reads as 1 + xi ■ 7^ in 
the first and second cases, Xi det A = —xl~^ 7^ if a;i 7^ in the third 
case. 



7.2. Case Ila. For the Case Ila, the stratification is as for Case I 
except that Sp is now given by: 



= {Xi =^1 = 0, X2 = 0}. 



Let us take j = 2, 021 = a^i = and A = Id. Then from the condition 
det {x2ld + x'\~'^ A^ 7^ if Xi 7^ we easily deduce that the matrix A 
must have non-zero strictly complex eigenvalues. Set 



A 



— /i A 



Then our conditions are satisfied and we obtain the fields 



6, X^,-'[x2^2 + xl''{X^2 + fi^, 



Xi [X2^3 + x\ + ^6 



7.3. Case lib. Here the non-symplectic layer Sp is given near (0,.^3) 
by: 

Sp = xl^2 + 3^26 = 0. 

Let = a{x')i2 + P{x')i3 = \{x')i2 + X2i3, with A ^ 0, A(0) = 0, 

as e.g. in ()5.19p : we may assume that X{x')/x2 is not an analytic 
function near the origin. 

Moreover let 021 = 031 = 0, h2 = 1 and = 0. Then we have the 
fields 

^1, X?"^ [\^2 + X2^3 + Xl"^ (0226 + 0236)] , Xl'^ [0326 + 0336] • 

Conditions 1)6.3.111) and ()6.3.12|) become det A 7^ and Ad33 — 632X2 + 
x^~^ det A 7^ if Xi 7^ 0. If g — p is e.g. even we may choose A = x|, 
033 = sign det A, 032 = to write a particular case of the above fields. 
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8. The behavior of the bicharacteristic curves and a 

finer classification 

In this Section we present a classification of tlie various instances of 
tlie "sums of squares operators" in which we get in Case I. 

Consider ()6.H.4|1 : Xi actually denotes the only non characteristic 
vector field. Let us consider the null bicharacteristic curves of Xi, 
7(x,aW = (^'^) +^_(ei,0), where = 0. If Xi = 0, then 7(x,o(^) = 
7{x',f')(^) ~ 0) is actually a null bicharacteristic curve 

of Xi issued from a point (0, x', 0, of Si. Assume t 7^ and compute 
X2 and X3 on such a curve. We obtain 

(8.1) +n23it,x%] 

^3(7(.',foW) = tP-'[{X{x')a{x')+a,2{t,x'))^2 

+ns3{t,x'%]. 

Assume that the point (0, x', 0, is in a neighborhood of (0, 63). Then 
^3 7^ and also a{x') 7^ by Theorem 16. 3. II On the other hand nothing 
is known a priori about the function A. We point out explicitly that we 
chose X2 as the field having a non-zero 8/8x2 coefficient near (0,63), 
thus breaking the X2-X2, symmetry. This is evidently no restriction of 
generality, provided we bear in mind that analogous statements hold if 
we interchange the roles of X2 and X3. 

When t 7^ we may consider the characteristic set of X2(7(j./ |-/)(t)); 
we obtain that X2(7(j,/ = if and only if 

a{x') +ta22{t-,x') 



Let us now compute X3(7(^/^/-)(t) 



; we get 

^2(7(^',f')W)=0 



aix'^ 



^•2) WYT^^f -A(.')a.3(M')+a33(t,x' 



+ ^deti(t,a;') 



where the quantity in square brackets is that playing a role in Equation 
(j6.3.6j) and is non- zero provided t 7^ 0. We also point out that the 
coefficient a{x'){a{x') + ta22{t,x'))~^ is also non-zero at t = 0. 
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The above discussion motivates the following 

Definition 8.1. We say that the fields Xi, X2, X3 of \6. 3.4 ) are in 

Case Iq or of type Iq if 

(8.3) -A(0)a23(0,0)+ 033(0, 0)^0. 
This means that, as t ^ 

^3(7(.^,-oW)L ^^^^ -t^-\ 

uniformly with respect to x' , ^3 7^ 0. 

Assume now that iS. no longer holds and let 

(8.4) -A(0)a23(t, 0) + S33(t, 0) + ^ det A{t, 0) ~ f, 

as t — >■ 0. Then we say that the fields Xi, X2, X3 of (|6'. 3.4 ) are in case 
If or of type Ir, r > 0. This implies that 



^3(7(x',5')W) 

for t — s> and x' in a small neighborhood of the origin. 



^2(7(^',e')(t))=o 



The first and second examples in Section 7. 1 for Case I operators are 
of type Jo, while the third example is of type Iq-p. 

We will find this property to be relevant for the Gevrey hypoelliptic- 
ity threshold of the corresponding sums of squares operators. 



9. Gevrey regularity for sums of squares of vector 

FIELDS OF TYPE Jq 

In this section our purpose is to deduce microlocal Gevrey estimates 
for operators of type Iq. For the sake of simplicity we slightly modify 
our notation in ()6.3.4|) . Thus let us consider three vector fields of the 
form 

X^{x,D) = 

(9.1) X2{x,D) = a2i{x)D^+x\-^f2{x)D2 + x\-^g2{x)D^ 
Xj,{x, D) = a3i{x)Di + xl"^ fi{x)D2 + xl~^ g^{x)D:i, 
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where fj and gj, j = 2, 3, are real analytic functions defined in a neigh- 
borhood of the origin and such that ()6.3.5p becomes 

(9.2) f,{0,x') + 

/3(0,xO = A(x')/2(0,x') 

and 

Moreover (jfi.H.fij) becomes 



(9.4) -\{x')g2{x) + gsix) + 



/2(0,x') 



det 



f2-f2{0,x') 

f3-h\oy) 

Xl 



92[X) 

93{x) 



7^0 



if Xl 7^ 0. Now the assumption that our operator X]j=i -^j is of type 
/o means that 

(9.5) -A(0)(72(0)+^73(0)^0. 

The latter implies ()9.4|) . while ()9.4|) makes sense due to ()9.3|) . 

Lemma 9.1. Let a, (3 and 7 be real analytic functions defined in a 
neighborhood of the origin in M.^. Then we can find real analytic func- 
tions a, b and c such that 



a{x)Di + (3{x)x''^ D2 + 'y{x)xl D-^ = a{x)Xi + b{x)X2 + c{x)X3. 

Proof. This very useful lemma is a simple consequence of the assump- 
tions, and says that the span of the vector fields {Di, x^^^ D2, Xg^iD^} 
is that same as that of the vector fields {Xj}. Using elementary row 
and column operations on the matrix on the right hand side of ()9.H) 
the Lemma states the invertibility of the matrix 



(9.6) 



f2{x) g2{x) 
fi{x) gsix) 



which, in view of ()9.2|) is equivalent to the invertibility of the matrix 
(9.7) 

But this is just (j9.5p (all locally). 



1 5(2 (x) 

gs{x) - \{x)g2ix) 



□ 
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Lemma 9.2. For j = 1,2,3, and m an integer, 

3 



£=l V^/ h=l 



m-e 

3 ' 



where 

(9.9) |5%?l<C;:l"'(^+l«l)! 
Equivalently, 

(9.10) dtx,^-j:("^)j:^i2x.d 

w/iere 7]°'' = -6jh- 

Proof. This is just an iteration of the previous Lemma. □ 

Let denote by a cut off function identically equal to one in a neigh- 
borhood of the origin in M'^. Due to the special form of our coordinates 
and the fact that the characteristic manifold is simplectic, we may as- 
sume that (fi is independent of the variable xi: in fact we may always 
take V9 as a product of three such cut off functions each depending on 
a single coordinate, Xj, and every xi-derivative landing on (p{xi) would 
leave a cut off supported in a region where Xi is bounded away from 
zero, hence in a regioln where the operator is (uniformly, microlocally) 
elliptic. Thus we take ip{x) = f{x'). Here ip is assumed to be a function 
of Ehrenpreis-Hormander type (see e.g. [12], [201), i-e., denoting by U 
our neighborhood of the origin, then ipj has the following property: for 
any U compactly contained in U, and for any fixed r G N, we choose 
(fj = (fj^r G C^{U), (f = 1 on U and such that, with a universal con- 
stant (i.e., depending only on the dimension of the Euclidean space in 
which we work) Co such that 

\in^^Ux)\<i r'=forA;<3r. 

It is a well known fact that the operator 

3 

P{x,D) = J2Xj{x,Dy 
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is C°°-hypoelliptic and satisfies an a priori estimate of tlie form 

(9.11) Yl ll^^-^ll' + ll^llv. ^ ^ (K^«'«)l + ll^f ) ' 

i=i 

wliere m is a rapidly decreasing smooth function, \\-\\s denotes the usual 
Sobolev norm of order s and || ■ || = || ■ ||o is the norm. 
We want to obtain a bound for an expression of the form 

(9.12) \\Xjip{x')Dlu\\, 

where, since we are in a microfocal neighborhood of the point (0,63), 
Z?3 is an elliptic operator. It is well known that obtaining a bound for 
flO^ of the type \\Xjif{x')Dlu\\ < C+^rl' allows us to deduce that P 
is Gevrey (micro-)hypoelliptic of order s. 

Remark 1. We would like to mention here that in the case of the second 
example of Section 7.1, i.e. the Oleinik-Radkevic operator, the authors 
in jS] proved that one has C^^^ hypoellipticity and that this bound is 
optimal. 

Instead of bounding the quantity in ()9.12|) . for technical reasons we 
want to bound the more general quantity: 

(9.13) \\Xjxy^^^Dl-'u\\ + Wxy'^^'^Dl-'uWyq 

where a, b and c are positive integers with a < q but b and c bounded 
only by r. Using ()9.1H) . we see that ()9.13|) is bounded by 

(9.14) liPxIifi^^^Dl-'u, x1ifi^^^D;-'u)\ + \\x1ip^''^D;~'uf, 

modulo a positive constant in front of everything appearing in the above 
formula. We need to move P in fl9.14|l to the right (onto u); the term 
with the norm will be easier to handle. Writing P = SX^ and then 
[X\ V] = X[X, V] + [X, V]X with V = x^^^^^Dl-^, we find 

{Pxl'^^^'^Dl-'^u.x'l'^^^'^Dl-^u) = {xl^^^'^D'fPu.x'l^^^'^D'f^u) 
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(9.15) + 5^(X,[X„a;?v^(^)Dr>,^i^^'^^r^) 

3 

i=i 

The first of the above right hand side terms is good, since we assume 
Pu to be analytic, even 0. 

The second and third terms on the right hand side in ()9.15|) have 
many common features, which we may treat with the help of Lemma 
El 

For j=l, we have 

(9.16) [Xi,x>(^)Z}^-"] = axrV^^^^r'' 
and so 

(9.17) 

[X,,xly^^^^D;-'']Xi = XiasrV^^'^^r' - «(a - l)a;l"V^''^^3"'• 
ForJ=2,3, 

(9.18) [Xj,xy^^^Dl-^] = f{x)x\-^x'{^^^+^~^Dl-''+ 

1=1 ^ ^ h=l 

with / analytic, and thus using Lemma [9.21 again, (j = 2,3) 

(9.19) [Xj-, xl^^^'^Dl'^]X^ = /(a;)a;r^2;>(^+i)Z}5-%- + 

1=1 ^ ^ h=l 

1=0 ^ ^ h=l 

1=1 ^ ^ /i=l £i=0 fc=i 

Going back to ()9.15p . the first term we have seen is harmless as it 
contains Pu. In the second, we integrate by parts and use a weighted 
Schwarz inequality. Since X* is equal to —Xj modulo a zero order 
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term, the second term on the right in using and ()9.18|1 . 

becomes 

3 

(9.20) |5^(X,[X,,x?(^('')Dr>,^?^^'^^r«)l < 

3 
k=l 

+ c,\\fix)x{-'xtv^'+''>D;-%r+ 

l<h<3 i=l ^ 

2<j<3 

This expression we leave for the moment and treat the issues which 
arise in the double commutator needed for the last term in ()9.15|) . 
those which have already been expanded in (j9.17p and (j9.19|) . 
We may continue with ()9.17|) in ()9.15|) : 

(9.21) {[Xux1ifi^^'^Dl-']Xiu,x1ip^^'^D;-'u) = 

= {XiaxI'^^^^^Dl-'u^xl^^^^Dl-'u) 

- (a(a - l)xl~^^'^^^ Dl-^u.xl^^^^ Dl-^u) . 

We shall also continue with (FmUl in (PnH|l : for j = 2, 3 

(9.22) i\Xj,xl^^^^ Dl-^]X^u,xl^^^^ Dl-^u) = 

= E (':')(/(x)f^r^a:?^(^+^^x.z^r^-^«,^?^^^^^r^w 

l+li=l V ' 1 / h,k=l 

Here we have used the 'multinomial' notation for brevity: 
/ a \ a\ fa\ fa — (3\ 

^/3!7!(a-/3-7)! ^ WV 7 )' 
Before collecting our individual terms we throw in a kind of 'sym- 
metrization' of the first term on the left, for errors will often appear 
in this form. In so doing, we will encounter one more commutator, 
which is covered under the fourth and fifth terms on the right, hence 
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contributing nothing new. We also drop the subscripts on the vector 
fields now. From (Pm|l . (jCTjl . and (jlTTKl) . (POHl) . (j!OT|) . (FO^ we 

have, for any positive e, 

(9.23) \\Xx''^ip''^Wl-^u\\ + ||a;?v5('')D5-%||i/, + < 
+ eWXxlip^^'^Dl-'uW + Ce\\ax1-^ip'^^^Dl-'u\\ + 

2<j<3 1=1 ^ ^ 

+ |(a(a- l)xrV^'^^r'«,a;?(^^'^^3"'«)r^'+ 

J=2,3 

= Jl + J2 + Is + /4 + /5 + ^6 + ^7 + 4 + h- 

9.1. The term Ji. This term is harmless since Pu is real analytic, 
even zero, in the support of all y?. 

9.2. The term l2- This term will be bounded by a small multiple of 
(j9.13p if we take the support of all the localizing functions small, and 
hence may be absorbed. 

9.3. The term I^. This term is already a small multiple of ()9.13p . 
hence absorbable for e small. 

9.4. The term h. This term, Ce\\ax1~^ip^^'> Dl'^^uW, exhibits an overall 
gain (in the norm) of but pays for it with a decrease in the power 
of Xi- We will consider this term further below. 

9.5. The term I^. This term, bounded at once by 

CfCe\\xl'^xl^^''+^^Dl~'u\\, 
suffers a new derivative on Lp but gains the factor 
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9.6. The term Jg. This term, easily bounded by 



sup {C^ry\\x\^^^^XDl' 

\<i<T-C 



u\ 



in view of the estimates ()9.9|) . where depends only on the coefficients 
of the Xj and their first few derivatives. This term will be further 
treated under /§ below, where also the term with £ = appears, though 
with a small constant in front. 

9.7. The term l-j. This term, 

|(a(a - l)a;rV^''^^r'«, 2;^<^^''^^^'w)^^^ 

is bounded exactly as is J4 above once one power of a is moved to the 
left and the Schwarz inequality applied. 

9.8. The term Jg. This term, 

<=0 ^ ' 

J=2,3 

permits us to move x^-^^ i^)^^^"^^ to the right and y^'-^-' to the left, apply 
the Schwarz inequality and bring both / and 7^^^ out of the norm. The 
result is 

(9.24) ellxV^^'^XD^-^ll +sup(C^r)^||xV^^^^^r'"^«ll 



a+p-l,„(6+l) lyr—c 



u\ 



'3 

The last of these is exactly like J5 above, while the supremum, has 
been met in Jg above. The first term, which we note carries the small 
constant e, will be absorbed on the left hand side of ()9.13|) once the X 
is commuted to the left. 

9.9. The term Jg. This term, 

J=2,3 

carries with it some of the features of all of the above terms. We 
want to move X to the right, use the weighted Schwarz inequality, 
and estimate the derivatives 7^^^ just as we have done before. But two 
things may happen: in first commuting X to the left another derivative 
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may fall on 7^. (doing no harm - the estimates on these derivatives are 
flexible enough to handlle one or two more derivatives by changing the 
constant a bit, uniformly in r). But the coefficient x'^ip^''^ may also be 
differentiated by X. No matter - this has happened often before, and 
either ip receives one more derivative gains a coefficient of as in 
/s, or x1 becomes a;^~^ as in 1^. 

Putting these results together, the error terms, apart from those 
which may be absorbed on the left, we have arrived at 

Lemma 9.3. For any a, b, c, and r we have the estimate 

WXx^.if^'^Di^w + \\xiip^'^D;-%\\^/, + \\x^,^^'^xD;-%\\ < 

(9.25) IKv^^^^D^P^II + sup iC^rY\\x1ip^^'^XD;-"-^u\\ 

l<i<r-c 

+ Wxt'^^'^Dl-^W + ||a;t+^-V^'+'^^r'«ll = Ji + J2 + J3 + Ja. 

And these terms are of four distinct types: the first involves Pu and 
is harmless; the second exhibits a gain of I powers of at the expense 
of I powers of r; iteration will lead to [CrY ~ C^r!, which by itself 
would lead to analytic growth. 

For the final two terms, J3 and J4, we argue as follows: 

1) In treating terms where a power of x has been differentiated, 
we invoke subellipticity, writing 

and estimate E using the standard calculus of pseudo-differential 
operators - giving rise to a sum of terms, in which a typical term 
has k more derivatives on (p and k fewer powers of D3, modulo 
an error with no derivatives on u. This trade-off, -Ds's being 
transferred from u to is the sort that would lead to analyt- 
icity. At any rate, the principal contribution is similar to the 
second term on the left of Lemma 19.31 with a decreased by one 
and c increased by 1/q. 

2) We observe that when a = (at the outset, for instance) this 
kind of term does not arise; thus J4 will be the first term to 
arise, starting from ||(y9D3M|| : ||(y9D3M|| — > \\x\~^ (p''^'> D'l ^^'^u\\ijq. 
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3) Alternatively, when, as in 2) just above, one does add p — 1 
powers of Xi, add a full derivative to (p, one may reach a total 
of g — 1 x's, in which case one invokes Lemma (9. H and writes 
x'^^^D^ = "^bjXj and does not employ the 1/q— 'shunt' in the 
first item just above. If the powers of x do not permit this, we 
use the subellipticity again. 

4) All together, then, we observe that after s steps of type 1) and 
k steps of type 3), starting from a = b = c = 0, we will have, as 
'worst' errors, 



where after the last step we have not taken dI^"^ and moved it 
to be part of the norm; for this time, assuming that we have 
approximately g — 1 powers of Xi, we will use Lemma l9.ll to 
'create' an X. 

Whenever possible (when the powers of xi grow to g — 1, we do not 
take advantage of the subelliptic 1/q gain but combine x'^^^ with 
to produce an X instead. This may happen t times. The result is that 
after s + k + t iterations we have an expression 

(9.26) /||v^«xt(^-')-^-*(^~')D;"'"'^"*M||. 
Now |(^(*^)| < C'^+V^ so that (FT^ is bounded by 

(9.27) C^+V^+^||xf(^-^)-^-*('^-^)Dr'-'^-'..lU.(.„,,,). 

Since we are looking for powers of Xi as close to zero as possible (where 
we started) to gauge the effect of returning to the starting point, it is 
natural to take 

_ k{p - 1) - 5 
q-1 

or its integer part. This choice of t reduces the quantity in ()9.27j) to 
the following 

(9.28) C^+V^+*^||D;"^''"'')m||. 
Upon iteration we get 

(9.29) C^^ '^^CW^^ ^^+^. ''^ \\dI'^' ' 



u\ 
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where 



-■-E^.-fE*.-"- 



Let us write K = kj and L = ij . Then 



K+L K+L 





since q > p. This ends the proof of the following 



Theorem 9.1. The operator 



3 



where the Xj are given in i9.1]} . is Gevrey hypoelliptic of order |, i.e. 

q 

Pu = / G implies that microlocally u & C^, s > -. 

p 

Remarks The results given are microlocal. To provide a proof in all 
detail would entail introducing cut-off functions which are local in space 
X and also in the frequency variables ^. This can be done, and has been 
carried out in all detail in [211 |2S1 in the analytic case and in |3] in 
the Gevrey category. One introduces localizing functions with the local 
behavior used here and conic localization in the frequency variables, all 
cut-off near the origin in the dual variables (with analytic error) in the 
manner detailed in j2S]. We omit details here, as they would largely 
repeat [22] and risk rendering the exposition unreadable. 

In the case of the Oleinik-Radkevich model we know from [H] that 
these results are optimal and that in particular the result is analytic 
hypoelliptic if and only if p = q. We also strongly believe, but have not 
yet been able to prove, that every 'threshold' obtained in this paper is 
also sharp. 
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